Activation function

Rectified linear unit (ReLU)
Leaky rectified linear unit (Leaky ReLU)
Logistic function (Sigmoid)
Hyperbolic tangent (Tanh)
Exponential linear unit (ELU)

REFERENCES:

0. Mina Basirat, Peter M. Roth. The Quest for the Golden Activation Function.